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Si;. 

Ay ^■=<'B»^fiR:??}*tci3v>T, 

^iii»%f^«-r « c i: *1tfS i: "T S Ay ^ -^BB^^figT? 

[0001] 

t#«Ay^viS»^«->x-rA. SC^Ay^va^^flc 

CO 0 0 2] 

[0 0 0 3] «^*^^(ci3<,^Tti, iEffi;«;^^^x^ 

«rSf» LfzK). * /-caa^SJgftc 5i-f J L T -7 K T'iSift? 

[000 4] 01 6 (a) . (b) . (c) {4, fi^O 
Ay-7-rH»^fi8©-P*^-ro |oI0 (a) . (b) C 



*3I/''T14, 2ttOiii»2 0 1 . 2 0 2*^P>:j-— ^ y 

^fiitLTAy^viSIJz 0 a^rtfTVSo 
[0 0 0 5] 

[0006] 01 6 (b) 0/^y'7Viii®2 0 acDJ:^ 

T*S;^57^-^»JB^{^t-5fcl6. 016 (c) {c^-r<t 
3fC/V^Vgi#2 0 3 ^^-^-r 2 0 4^:^^ 

mm 2 0 5«r)i^*fe-^/^^->-ea*siio#©*^ 

i:P)tiTv^fc:o ^(Dtztb. Ay ^Tiiififc^figiciOT'^ 

[0 0 0 7] *^fla{4±fSfie«<DRgffiji5ca*, ^^s- 

[0 0 0 8] 

tc, »*«i ©Ay ^viii®^figs/X5^A«, ^mti. 
1 tt<D/V'5-ri®««:{trii-rs/<y ^TiB^^figi/xf^ 

30 a-:5i,^TBijEAy^Tiii«%ft«-r«''^y'5viB»f^)5!t 

[0 0 0 9] IS*S2(0/^y^vSi«f!-&fi)ci^X7^Al±, 
±fe3S^« 1 <DAy ^viii»^figs/X7^Aic^v>T, to 

[0 0 10] iS*^3©-'^y^vjii®^fi!t->;?.7^Al4, 
±E»*JS 1 oAy^ v^l«^^fiR->X7^A^i:^3^^T, HtJ 

m'^mmmmm^mit. sstomj^A^-^icjcowie 
[0 0 1 1] ii*«4«D/V^-Tiij^^fi!c:^S{4, m« 

i: LT-gBA^;t- /^-^ -y r LTV>;5^tSj®iii^*^J5g 
L, 1 tt^OAy vviiiSi«:f^fi!t-r 5 Ay ^ viii^^fig;^ 

50 [0 0 1 2] 
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CO 0 1 3] El 1 {is *^H^cDIISgcO— Jg.^lC^^S/V 
^^•y ATfeS/^— V-:^/l/3>lfa— ^'->XT• 

^"i'twpfeSo 10 

[0 0 14] S-fs Hztc^f/^— v^^yun^tfa. — 

T^-r vy-r/Wxt?fe5-7>JyX, 4(iv^x#i'>, 5 

7*^SEiK^nTv>So iR.ffl'r>'^»— :7i— 5K75r 
ip]/<^wi"i'>^':7x— x-^s c s I -r^^f— :7x— X 

%o 20 

[0 0 15] ^JlfitimfficD/^y^viij^^figi^X 
[0 0 1 6] 0 nc^feV^T, 1 Hi^-N— K-^/xr. 12 
X-f-A (OS) . 1 3l±OS 1 2®±T?lbf^-rSTyj 
1 fcOS 1 2^^fig-rsra-y^03-^. ^figgfi^fcL 

[0 0 17] 1 4liyT-<JV^7'—$'^Vtsmff3lC 

- F 'J' X T^jiciHir-r 7 r ;l(DXtiitl^n^^ J: o 

ic-r^mmti^&^o i ett^r-r/i/i^xT^Ai 5*v^- 

Ff'i'X^ 1 4©S!*t»t^ff ■5fc46cDf'-<X^ I 
y^-:7x-XT-fe5o. 1 TtiOS^^figf^liilga 
■>XxAT*feO, ZyU'5r-v^3>'V7h'i/xZ^5icM 40 

[0 0 18] 1 8l4}iiiiWa->XxA 1 7A^-r-f XTT'b 

2 fCfliBi^rfT^ /tlitOlff'^t'l' ^^f-^x— XT'* 
5. 1 9(40S^^fi!t-r5A;'3xM^'Xga->XxAT' 
5o 2 0(4A:^f"/WXgS>'Xf-A 1 9*^4^— ^-K- F 
5 ©A:tJ^§lt5fSfc46<04^-.-}?- F-r X- 
X, 2 1 {4A:^v'/WX'ga->X7^i» 1 9*<V»>X3*> 



x-r > :? — :7 X — X -cfe 5o 

[0 0 19] 5&fC. «?*;>{^7t4. 5R^|qJl'>^- 

:7x-xtL<(is c s i-r>^'-:7x-x2 zicmt^ 
$n> A;'37'''^-rxBS'>XT-A 1 9^JiLT. a^-r 
-^m<D-^09!?D^tT3ili:A<T'*So 2 3t4il»-r- 

^fwa->x-rATa&»), 2 4im»7'-^^yr-f)i^^ 

A:'] fc <k 5=^^- -7- F^T'«llg L^^-r S x- if 
[0 0 2 0] /<y'7-7jli^{^fi8S/X'rA2 614, iii^H 

So 

[0 0 2 1] waLfcao, *>'X-f-A{4, m^^y^^ 

[0 0 2 2] «^^;*>p{^7 7?»4, SI»5nrcB»i:« 

tc, M141f$Si:LT«^B^^«^^~F^*^iB^?n 
5o >'V-7-Ti®«ffl©iii®^ffl»-rs(S(c{4«?*p<7 
7«JgK*-F* 'V V5-rii5»ffl^^- F" {c-lr<yF 

[002 3] ^^y vTisits^^-Fcftcji^^nfca 

»{4. aitlS^iftc, «»^~Ftc{4 'V^y^TiS^ffl 

!g^~F"*\ io<D/<y^viii«i*«i^-rsf= 

[0 0 2 4] B3{4. i3yi'7(fi(Dmmf—S'^::2>if:3. 

[0 0 2 5] ;^»;><^ 7*iRffl-f'V^' — :7x— X6«:/1-L 
T3>k!ii-^{Cg!i^L, ia»7"-^Sa->X7^A2 3 
^eitl-rSo ilii«'r'-tS'WSS^X7^A2 3(4, ^^■^rt 

F'^7 3 Uca^-rSo 3 2{4iii^7'-^<D^/J«« (-y- 
L.^-iimm') , 3 3{4iiiSi<D«tt1fffii:LTS»B^ 

#*^a^?ti«.o 3 4^4/<-y•^;^=l>'tfn-^'^o>'^— 
F7'-rx^4'^c#ffi■rs3.— »f«oB«7*— :S"<-x<^)— 

gP^S^LTV>i)tOT'fet), cn**->X-ri»-t?{43. 
— !f * ^ □ ^ i: ^A.T-t ^ S , 
[0 0 2 6] 3.— tf(4*p<^:^^ny3 1 (f *^e>ia^* 
(3 5l4®«*nfcCi:*a^-r5«i) , =l- 
•*fti'$'xnif3 4lc-r^7.3X'D r a g&D r o p^SSft 

(*^^F«9li:T^-^i{4J^5) , ^m^Ji<Di)^ 
x-i't4?S*?n5) {4, :i— »f<DJiST?if-&&fCTt, 
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[0 0 2 7] ctDntr-^sif^coacffc. /^y^-^m^'e 

10 0 2 81 m 4 iCJSl^r. ^-f. X7^yysiT% :i 

— <f * p ^ 3 4 {c F u «y tirc-9- A:*.— wiS-r 
T-yZfSZXHi. SlSli^f (Dffl^t- K^Srii'^T/ V 

[0 0 2 9] 05«. tl}tB;^'r>yrs 4©/<y5-^-&^ 
mmoDyn-^^—hT'^^o 20 

[0 0 3 0] s-f. 7.-7^-y:^s 1 iTit. ^^r^mm 

^m^X. BSiWO;*— /^-^-yyfiilS OttS^) 

ttJ-r^o ->:lcXx-y::/'S l 2tc*5V>T> Htjf5X7^>yys 

[0 0 3 1] Seti. j:<HS^}Sttl«Qa(OT;brJUXAcD 
dClTti^ ■kt^<Dmm.4 1. 4 2 © 2 tSCOfi^lJ^^-To 

[0 0 3 2] *->xxAT-{i, ^^y^-rmmtLzmf^ 

t^t^cOJl—JltLX. «/M0%. «:^50%Si«S 
■rn^^-n^n5%Ji(Ti:j*J6e>txTV^5o C(DCi:{c 

nftit?>}^ti^^tEt^-^mi±<ommt\,^vctx\ mi 

0 0%. 5 0%©S5ffl4 4 fC^S^tl-So 
[003 3] mm^(D:iLVT 4 3i3^P>. x-y'>'A^m^ffl 

m^7->-fu-hm»tvxmoiii-to c<07->-fu- 
hmm4 5?r. ■9--f^si5H4 6±^c:fe^,^T. a^^fa-p 

^mm±^imm-r-D-f^LX7^tbio ^-^mm±^ 

^<0:f>-f>hm± (x. y) t (x* . y' ) so 



10 0 3 41 &Jlt)mm<0mSti3:^i)\ cn%06O 

[0 0 3 5] ^-Tx XT'yys 2 1 T*x-V'>*amil®^ 
f^fiJcL. X7^«y:/S2 2T% C<Dx-y >'*atBH»<04'<D 
x>:/U-h^iS«-rS8BH4 3*^?>. xyi^^^m^ffl 

L7">:/U'-hiii»4 5i:L (XxyyS2 3) , ^-(0 

:i^'r>'Ko(aa*^P). sia»4 2ifo-9— ^ieH4 6«: 

^Sf 5 (.T.'r yZfS 2 4) o 
[0 0 3 6] ^LT. -9— ^S5Ht|5(Diii®4 6 -rV 

5) o c(DM5i-o-&ftM*\ -f-nsT'^a^hfiiA^if^*^ 

^^x>y^L (X-T^-y^S 2 6) . T'^ntf Xf^-y 

[0 0 3 7] ?e>{C. XT--yrS 2 8T'-9— ^®!B^T 
^-^ofcjb^^^x-y^'L, X-r-y:7'S 2 9-e, ^©ifiSS 

j^*^) m^mLt]t^Lxpm-r^o msMLj;?? 

*«0Wbfcd«'r>hO^«l (x. y) «/hfiiA^* 

iie.n/c^j^-i'vhtD^^ (x* , y* ) -fios/^fii 

©fili::grS8i-r-5 (X7^-y:/S3 0) o 

[0 0 3 8] i:i±^'r>yi'-h^mmm±mciiLx 

(Xx-yyS3 1) . i^TL^ce.«JS^^O';xh4" 

jimtLx^m-r^ (XT--y:/s3 2) » i:i±T*^>tts^ 

[0 0 3 9] :kic. Miexxy:/s 1 1 (otiit^j^mmmk 
mmcnt:>tx^7.y-^yys 1 2<o^fiE>'^^y-^'©mja 

[0 0 4 0] mm^^Z^LtLtzttlC (2«Iti±<D^fig 

2fecD^fijt£O!^0igL^<DT% l^-fiiZtkt 
^K.TJ:V^) . ^-cD-rtlti, X. yT^IojOMit. (h1I£& 

(x. y) , (x* . y* ) {±i;iTO <fe 3 fc^-frSo 

[0 0 4 1] 

[ISi^l] 
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(/n(oos6 -x -I- sm6 •J' - Ax) \ 
m(-sin6 'X + cos0 -j* - by)) 



t Ax^By + C\ 



^■To ioT. — ifA. B. C. D^r^i&SCi: 

tB5QST'{±. (x. y) . (x* . y' ) (D^Si 

A. B. C. D**46So 
[0 0 4 2] 
CS(2] 



nun 



CO 0 4 3] 



te/M - {^x' ^ x^')^ ^(Sj')^ ^ - 



[0 0 4 4] 
[^4] 

tt^t. >'^^^-^A. B. c. D{i^>ioj;3(ca-r 

[0 0 4 5] 
[SS(5] 



30 



40 



Pa ^pl-PiP» 



^ Pi-PtA-PjB 
Pt 

P-,-Pi^*PxB 
P% 

fcicit). /^^p«-^A, B. c. D«r»ta-r5o 

[0 0 4 6] :^»C, 7.7- "J -fS 1 3 iDK^^filtfflafCO 
V^TgiWrSo /^^p<— ^fA. B. C. D«*i6€>nfc 

[0 0 4 7] 
[S(6] 



\y')\-Bx*Ay^D] 



so 



ffl^-^fiStma^s^f^c iii^A^*. ^mm5 1.52 

cD«^. :feiii»5 iiD2fg©:#ct^*-&figili®5 3i:L 
TSI^-rs, cctc, $-r:feiii»5 1 ^^■^0**3fcr- 
LT<5 (5 1' ) , iSfUc. ^fi8iii«tO«00«« 
(x. y) 5 4tCOt^T. ±S*^e>, «JC-rS®« 



(6) 



14 0 7 



(x' . y* ) 5 5**465o ^LT. :&ili«5 20 
(x- . y' ) <omm^ (x. y) tC3e--rS (5 

[0 0 4 83 09«. SIS-&fi!c5QS^^-r:7a-^-v- 
CO 0 4 9] X7-y:fS 4 IT\ mi £Oiii® (08T<?D 

XT--y:^s 4 2T% mi <omm^c(o^^mmmmcm 
®« (x. y) tcoi-'T, ±ic*^p>. *ff£;-r?>miii 

(x' , y* ) ^5R46So X-r-yT'S 4 4-e{i> 

(x' . y' ) 3b\ ^2cOiB® (0 8 rttc 

(x* . y* ) (DMfk^ (x. y) {i:r3lf--r5, 

CO 0 5 0] J.::(±?r^figiiifi»O5S0<D««±T{CWLT 

C00 5 l]'^^^^ 0 4^Lrc:XT->y:^S 5<Diii^JSa 

tct t)ateiii^A<8ilS*nSo 010 (a) ~ (d) 
CO 0 5 2] /V5vH»*f^^-rsrci6»c2tS:<Diii» 
(a) ~ (d) ic^-r^^yy-^mmit. 2«?®iB»6 

[0 0 5 3] ^-r. isi0 (a) {c^-ram^^s 1 (i> 7j< 
sA^atB^nsc 1510 (b) icTjk-rmmysmziii. 
(ox\ c(Dmx'i,i^B6 4f)miiit[ti?>o mm (c) ic 40 

^•rttlB:^S3«. 2l*oi®»M<o«#©^«'fcit«v^ 

6 5*^aa^n^o ^fc. am73^2&?>*aa7?}4 3tD 

ttttiiii»6 4. 6 5«. -0/2rctt|pI 
te5nT{«#©i*i/>iS»'r— ^ffc^So |B|0 (d) 
-raa:^rS4{i. 2ft(0iii«^tttc-&A.T'V^5^}g*a 
tb-r^tcDT. c<Dmxiim.m6 6i3'^!itnc'^rz^o 

CO 0 5 4] tc^X\ 2ttC»iii»©a^07Jfc(i«>J? 



10 

tii-t?>^B(o-m^^^irmx'&*). ctiii. mmys^i 
icj:^m-^^mvx^K>. ^^^yy-rmmi i'p(Dmm 

0 1 2{c^-otttU-'^^'— >T— -r;!/©— SP^^-To 
[0 0 5 5] 0 1 2«0tf 8 1 ti. 0 1 1 fc^Lfc/^y^ 
Tjii^cD'y— XtCffi^-rSfeOTfeSo c:n*0 13* 

[0 0 5 6] 0 1 3«, ttJJB-'^^' — >7^-r-'l/OifiB^0 

<D{a«*SLTl>5o 01 3JiK> 2-D<D^B<om^0:^ 

9 lA^*i6e.n5o Sfe> ttta®tiE7 2©^]l;;^0^^ 
{i9 2C0<fc-5{c*i6P)n5o at±l>'^^f — V7^— :/;l'8 0 

m^m^-t^msi>^/x.x&^o 

[0 0 5 7] C©J:5tcLT5Ri6/-cfii*^^T<0«*D:^ 
CO 0 5 8] i^fc±iS LfcfflW/^^'->-r-:r;l'«rfflv> 

CO 0 5 9] $-r. xt^-v^s 5 1 {c*3i,>T. ±aiLfc 

s 5 3T'ti. 7—yji^(D "^m" (oms^^^. i^^stc 
ft; i: T mii^T^- ^ * Eig ^ -tir s o 
[0 0 6 0] Jii±iD> «>i?^«*t)73, ^rm^^t^ 

[0 0 6 1] /v^-riii»A^p,^sm•r 

S?-r5fci6Oj*ffiiiS*0 1 Sfc^fo 
[0 0 6 2] 01 5 <0 1 0 0 ti, 0 3 tsi/^T, :i— 1f 
A^'ay3 4tc;!7P<^*^'ny3 1 ^■'^/^y ^viB^-r 
— ^'^^D r a g&D r o p Stlfcli^tcS^iJnSiiiffi 
Tfe-So 01 SfcfeV^T. 1 0 1 {i/<y^T^fiSt^tlfc 

iii^i 0 2f3'^m^>in?>^^y ^•^mmmm^i^x$>^o 

«b*iB«-9- 1 O 3*^^ i O Gfi/^y^vB^ft i 0 

^(Df^sSi^m^mmx^mLxtso. ^-n^^namT^a 
1 *>e.aHj;5ji4tcta^LTv>So 

CO 0 6 3] a-Hftt^^^nTV^saWHfiR-y-^:?^;!/ 
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11 

0 7<D<fc3fca5^5fn«o a*3^nTv^s 

fc«-&«. o K y 1 0 9 ^m^-r 5 C i: 

y«r«i«-r 5 c i: t T- # 

[0 0 6 4] a±^0i^B^^C^3V^Tt±. /'^Z 7Tiii»%ft 
CO 0 6 5] 20 

i^moy^^mi J.x±i¥M l fc i ^ fc > i ^ y ^ 
■riii»^]5!t->XxAfcJ:n{f, }taoiii«<D^j5K^tOiiS 
»F*3*> P> ® i: ^ 5 ^i^»c^ $ n § Bi^T'- ^ i Sdfi*) 

[0 0 6 6] IS*«2<D>'^y^vili«-&^v'Xxi»ti:J: 
[0 0 6 7] iS*]13<D-'^y vviii^^fiKi/;^-7"A{cJ: 

10 0 6 81 mis^m 4 (D/^y^-rmm-^^yj'mc^n 

^ 5£}g * 5 MlSfc # $ n S Hi^T'- ^ ^ g K Wtc*a 

nlftgt^So 50 
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[0 2] *%B^<0/V7Vilg!^fig'>X-rA*^||fi(iSn 

[03] *;<^rt<DiB»T'-^'*3Vlfa — ^»rt'N:3tf 

[04] *p<^rt©iB»x-^'^n>t;a-:Jfrt'\=itr 
— -r 5 BStctT 3 ffia*^-r 7 a — ^ -V — h Tfe -So 

[0 5] /^y^T^figMato^a— ^-v-hT'feSo 

[06] J>ff5^atH«aa©7';l'rruXAO:7a-^-fr— 
[0 7] «)E£:^atbKiST?(D-r>7'U— hiB»i:v-y^ 

[0 8] mm^^!&m^7n-rmT&^. 

[09] iii®^fi)tJtta^^-r7D-^-\'-hT'fe5o 

[01 0] ^W7-7mmirib^mmiA^mm-r^:^m^ 

^■r0T-fe-5c 

[0 11] 2^(Dm»<Dm^jiK)y5tmiiir^mB'D-m 

^^•r0T'Si)o 

[01 2] ttta/^^f— -//KD— fi?IJ«:^-r0T-fe 
[0 13] ai±l>'^^'->"r-r;KDlttB^0T'fe«o 

[01 4] iii®jatb5aa^^-r0T'a&;5o 

[01 5] -'V^vis«*^€)i*tti-r55ejB«i«*s»?-r 

[016] ee3t5<D>'^y^vH^^fijt©— fl»j^^-r0T'fe 

[i?F#oifiM] 

2 T^-eX^U'i' 

3 -v^X 

4 V>irX>1?3f> 

5 K 

6 iftffl'l'>:5»-:7x— X 
7 

1 1 /N-K'^xT 

1 2 OS 

13 Tyuy-i^aVV^h-f xT 

1 4 Kt^-^XiJ' 

1 5 y7^)V'>X'rL. 

16 ■r^Xi' I O-Oif — 7x— X 

1 7 «ijaga->xf-A 
1 8 e7'*-f'>'^'— 7x— X 

1 9 A;'3x>'^-YX'ga->X7^A 

2 0 +-4<-F-l'y^-:7x-X 

2 1 v^x-r^^f— 7x— X 

2 2 }5W|p]>r>^f— 7x— X/S C S 11':^^— 7x 
— X 



(8) 
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13 

2 3 m^y'—'^>'SM'>7.7-L. 

2 4 f—^n^m 

2 5 f'—^Um^^ 
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2 6 /<y^vil»ftfi!tS/X'rA 
2 7 /V^v^fig^a 
2 8 
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[06] 



[08] 
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S21 



S22 



NO, 



^^""TyeS^ S23 
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S26^ 



S25 



NO 



S27 



S28 




tYES 



S30 



NO^-r->:/U— 



c 



A 



S31 
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S41 
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(x.y)(C«UT. 
X* *s Ax -h By -fC 
y - -Bx -I- Ay D 



S43 



S44 



(x'./)tt. IB 2 0) 



NO 



S45 



(x',yO<7)B«*(x.y)^iafcr- 
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[^1 0] 
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1 1] 
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80 



61 
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* NOTICES * 

Japan Patent Office is not responsible for any 
damages caused by the use of this translation* 

1. This document has been translated by computer. So the translation may 

not reflect the original precisely. 

2 **** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The panorama image composition system characterized by to have 
a rectangle field extract means extract automatically the image data 
contained to the field which serves as a rectangle firom the inside of an image 
after composition of two or more of said images in the panorama image 
composition system which compounds two or more images which a part 
overlaps as a field, and creates the panorama image of one sheet, and a 
panorama image creation means create said panorama image based on the 
extract result of said rectangle field extract means. 

[Claim 2] A field used as said rectangle is a panorama image composition 
system according to claim 1 characterized by what it opts for beforehand 
with a configuration of an image after composition of two or more of said 
images. 

[Claim 3] Said rectangle field extract means is a panorama image 
composition system according to claim 1 characterized by having considered 
as a configuration which extracts said image data with two or more rectangle 
patterns, having chosen a thing of arbitration fi-om the inside and using the 
selection result as said panorama image. 

[Claim 4] The panorama image composition method characterized by to 
compound two or more images which a part overlaps as a field, to perform 
rectangle field extract processing of extracting automatically image data 
contained in a panorama image composition method which creates a 
panorama image of one sheet to a field which serves as a rectangle fi-om the 
inside of an image after composition of two or more of said images, and to 
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create said panorama image based on the extract result of the rectangle field 
extract processing. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[The technical field to which invention belongs] This invention relates to the 
panorama image composition system which compounds two or more images 
which some images overlap, and obtains the image of one sheet, and the 
panorama image composition method. 
[0002] 

[Description of the Prior Art] More generally than before, the technique 
called the panorama image composition which compounds two or more 
images which some images overlap firom demand of photoing a wide image 
and making it the image of one sheet is known. 

[0003] In the electronic camera, low [ of resolution ] (little of the number of 
images) is specified as demerit in comparison with a film-based camera or a 
scanner. Panorama image composition is important for the image photoed 
with this electronic camera also as a means which photographs a high 
resolution image [ photograph / not only / a wide image ]. A manuscript, a 
magazine, etc. of one sheet of paper are divided into pluraUty, and are 
photoed, and, specifically, power is demonstrated for it to divide scenery into 
plurality and be wide, and take [ acquire about the same high resolution data 
as a scanner, and ] a photograph to high resolution. 

[0004] Drawing 16 (a), (b), and (c) show an example of the conventional 
panorama image composition. In this drawing (a) and (b), the portion 
overlapped firom the image 201,202 of two sheets was detected, the image 
was compounded and the panorama image 203 has been obtained so that 
they may lap. 
[0005] 

[Problem(s) to be Solved by the Invention] However, there were the following 
troubles in the above -mentioned panorama image processing. 
[0006] When the image made as a result of compounding two or more images 
like the panorama image 203 of drawing 16 (b) does not have a rectangle, in 
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order to make into a rectangle the image which becomes resulting and to 
make it the data format which can be treated by computer, as shown in 
drawing 16 (c), the rectangle 204 which includes the panorama image 203 set 
up, and means, such as filling with a suitable color and a suitable pattern the 
field (dummy area) 205 where the image information in a rectangle 204 does 
not exist, were taken. Therefore, the image made by panorama image 
composition had turned into an image which cannot be said as fitness 
including a dummy area. 

[0007] This invention aims at offering the panorama image composition 
system which can obtain a good image without a dummy area, and the 
panorama image composition method in view of the above-mentioned 
conventional trouble. 
[0008] 

[Means for Solving the Problem] In order to attain the above-mentioned 
purpose, a panorama image composition system of claim 1 In a panorama 
image composition system which compounds two or more images which a 
part overlaps as a field, and creates a panorama image of one sheet It has a 
rectangle field extract means to extract automatically image data contained 
to a field which serves as a rectangle firom the inside of an image after 
composition of two or more of said images, and a panorama image creation 
means to create said panorama image based on an extract result of said 
rectangle field extract means. 

[0009] A field where a panorama image composition system of claim 2 serves 
as said rectangle in a panorama image composition system of 
above-mentioned claim 1 is beforehand decided with a configuration of an 
image after composition of two or more of said images. 

[OOlO] In a panorama image composition system of above-mentioned claim 1, 
a panorama image composition system of claim 3 considers said rectangle 
field extract means as a configuration which extracts said image data with 
two or more rectangle patterns, chooses a thing of arbitration from the inside, 
and uses the selection result as said panorama image. 

[00 11] The panorama image composition method of claim 4 compounds two 
or more images which a part overlaps as a field, performs rectangle field 
extract processing of extracting automatically image data contained in a 
panorama image composition method which creates a panorama image of 
one sheet to a field which serves as a rectangle firom the inside of an image 
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after composition of two or more of said images, and creates said panorama 
image based on the extract result of the rectangle field extract processing. 
[0012] 

[Embodiment of the Invention] Hereafter, the gestalt of operation of this 
invention is explained with reference to a drawing. 

[0013] The bloclc diagram showing the panorama image composition 
structure of a system which drawing 1 requires for one gestalt of operation of 
this invention, and drawing 2 are the external views showing the 
configuration of the personal computer system which is the platform where 
the panorama image composition system of this invention is carried out. In 
addition, this operation gestalt shows the case where compound two or more 
images photoed with the electronic camera on a personal computer, and the 
panorama image of one sheet is created. 

[0014] First, as for the display whose 2 1 displays a computer system main 
part and displays data, the mouse which is a pointing device with typical 3, 
and 4, in the personal computer system shown in drawing 2 , a mouse button 
and 5 are keyboards. Furthermore, the electronic camera 7 is connected to 
the computer system main part 1 by the general interface 6. A general 
interface 6 is a general interface in which an image transfer at high speeds, 
such as a bidirectional parallel interface and a SCSI interface, is possible. 
[0015] Next, the panorama image composition structure of a system of this 
operation gestalt is explained using drawing 1 . 

[0016] In drawing 1 , the operating system (OS) with which 11 operates by 
hardware and 12 operates on hardware 11, and 13 are application software 
which operates on OS12. In addition, although naturally contained as 
reqxiirements for a configuration among the blocks which constitute 
hardware 11 and OS12, when explaining the operation gestalt of this 
invention, it is not illustrating about the block which is not needed directly. 
As an example of such a block that is not illustrated, there are CPU, memory, 
etc. by hardware and there is a memory management system etc. by OS. 
[0017] Moreover, it is the hard disk with which 14 stores a file and data 
physically, and the file system with which 15 constitutes OS, and there is a 
function to enable it to output and input a file, without application software 
being conscious of hardware. 16 is a disk lO interface for reading and a file 
system 15 to write a hard disk 14. 17 is a drawing managerial system which 
constitutes OS, and has the function which enables it to draw without being 
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conscious of application software. 

[0018] 18 is a video interface for the drawing managerial system 17 to draw 
on a display 2. 19 is an input device managerial system which constitutes OS, 
and has the function to enable it to receive a user's input, without being 
conscious of application software. A keyboard interface for the input device 
managerial system 19 to receive the input of a keyboard 5, as for 20 and 21 
are mouse interfaces for the input device managerial system 19 to receive the 
input from a mouse 3. 

[0019] Furthermore, it can connect with a bidirectional interface or SCSI 
interface 22, and an electronic camera 7 can let the input device managerial 
system 19 pass, and can exchange image data etc. 23 is an image data 
management system and 24 is a data control means for managing image 
data by the file name, attribute information or the keyword by a user's input, 
etc. 25 is a data display means to search and display the image data 
managed by the attribute information or the kejrword by a user's input. 
[0020] The panorama image creation system 26 consists of a panorama 
composition means 27 to compound an image in quest of the overlap location 
between images, and an image extract means 28 to compound and to extract 
the made image which is the featiire of this invention with a smtable 
rectangle. 

[0021] This system compounds two or more images photoed with the 
electronic camera, and creates the panorama image of one sheet as 
mentioned above. In case this system copies image data to a personal 
computer from an electronic camera 7 (transfer), it performs panorama 
image composition. 

[0022] In an electronic camera 7, photography time, photography mode, etc. 
are recorded as attribute information with the photoed image. In case the 
image for panorama images is photoed, the photography mode of an 
electronic camera 7 is set to "panorama image photography mode." 
[0023] The panorama ID with "panorama image photography mode" same 
[ the image photoed in panorama image photography mode ] in attribute 
information again is set to a series of images photoed since one panorama 
image was constituted by photography mode. 

[0024] Drawing 3 is drawing showing the actuation at the time of copying the 
image data in a camera into a computer. 

[0025] A camera 7 is connected to a computer through a general interface 6, 
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and the image data management system 23 is started. The image data 
management system 23 displays the data in a camera on the window 31 in 
which it was attached to the camera catalog and the identifier. As for 32, the 
contraction image (thumbnail image) of image data is displayed, and, as for 
33, photography time etc. is displayed as attribute information on an image. 
34 shows some image databases of the user who exists in the hard disk of a 
personal computer, and is reading this with the user catalog in this system. 
[0026] A copy will be performed, if a user chooses an image firom the camera 
catalogs 31 (fi-ame which indicates that 35 was chosen) and operates 
Drag&Drop with a mouse 3 to a user catalog 34. At this time, it changes 
[ (the data in a camera is eliminated), and ] by assignment of a user whether 
it is a copy and whether they are (data remains in a camera), and migration 
to both. 

[0027] In the midst of this copy actuation, if it is the image photoed in 
panoramic exposure mode, panorama image composition processing will be 
performed. The above processing is explained using the flow chart of drawing 
4 . 

[0028] In drawing 4 , the attribute information which accompanied first the 
image data and it corresponding to the thumbnail dropped with the user 
catalog 34 at step SI is acquired. At step S2, it confirms whether to be the 
image which investigated the photography mode in attribute information 
and was photoed in panoramic exposure mode. When it is not a panorama 
image, it registers with a user catalog 34 as image data usual at step S6. 
When it is a panorama image, the image data containing the same panorama 
ID is transmitted firom a camera in attribute information at step S3. In step 
S4, panorama composition processing mentioned later is performed using 
two or more obtained images. Then, the panorama image obtained by image 
extract processing in step S5 is made into the image data of a suitable 
rectangle, and a final panorama image is obtained. 

[0029] Drawing 5 is the flow chart of panorama composition processing of 
said step 84. 

[0030] First, at step Sll, the image to compound is investigated and the 
overlap location between images (corresponding points) is detected. Next, in 
step 812, the parameter for deformation of the image at the time of using for 
composition firom the corresponding points detected at said step Sll etc. is 
computed. Based on it, at step 813, two or more images are compounded and 
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the panorama image of one sheet is obtained. 

[0031] It is drawing in which drawing 6 shows the flow chart of the algorithm 
of corresponding-points extract processing, and drawing 7 shows the 
template image and matching range of corresponding-points extract 
processing. In addition, the example of two sheets of the images 41 and 42 of 
the left and the right is shown here. Since what is necessary is just to repeat 
composition of two sheets several times when two number of sheets of an 
image is large, as processing, it is fundamentally the same. 
[0032] In this system, making an image overlapping a minimum of 10% and 
a maximum of 50% and the gap of a direction which carries out a right angle 
to it are decided to be 5% or less as the Ruhr when taking a photograph as a 
panorama image, respectively. By this, the range 43 which sets up a 
template is set as 90% long and a 10% wide range. Moreover, the range to 
search is the range of a possibility that the point of corresponding exists, and 
is set as 100% long and the 50% wide range 44. 

[0033] From the area 43 in an image, an edge looks for a strong point beyond 
a predetermined value, and starts length and a n pixels wide rectangle as a 
template image as the center there. That difference is taken for this template 
image 45 per pixel on the search range 46. It shifts 1 pixel of search range 
tops at a time, and asks for the place where this sum total serves as min. If 
the minimum value of the resxilt of having searched all search range tops is 
below a predetermined value, it will hold the points (x y), and (x*, yO of those 
as a pair of corresponding points. 

[0034] Although the above serves as an outline of processing, this is already 
explained to details at once along with the flow chart of drawing 6 . 
[0035] First, an edge extract image is created at step S21, and an edge looks 
for the powerful point beyond a predetermined value from the range 43 
which sets up the template in this edge extract image at step S22. If there is 
the point, an image will be cut down with the rectangle of every **n pixels of 
every direction from the point, it will consider as the template image 45 (step 
S23), and the search range 46 in the right image 42 will be set up from the 
location of the point (step S24). 

[0036] And the absolute value of the difference of a pixel value is taken for 
the image 46 and the template image 45 in a search range per superposition 
and pixel, and the siun total is searched for (step S25). it confirms whether to 
be the minimum value till then (step S26), and if the total value of this 
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di£ference comes out so and there is, it will hold the coordinate and the 
minimum value of the point in that search range at step S27. A repeat and a 
point (it has the minimum difference) most in agreement are found out for 
the above in all search ranges. 

[0037] Furthermore, it checks, and the minimum value which is step S29 and 
was calculated as a result is a sufficiently small value, or (are they clear 
corresponding points?) it judges whether all search ranges were done at step 
S28 as compared with the predetermined value L. When smaller than the 
predetermined value L, the coordinate (x y) of the point which cut down the 
template image on the list of corresponding points, the coordinate (x*, y'), and 
the value of the minimum value of the point with which the minimum value 
was calculated are registered (step S30). 

[0038] If the above is performed to all template setting ranges (step S3l) and 
it ends, the average value will be calculated from all the minimum values 
under list of corresponding points, and this is held as a coincidence level 
value (step S32). Corresponding-points extract processing is ended above. 
[0039] Next, the synthetic parameter calculation processing of step S12 
performed after corresponding-points extract processing of said step Sll is 
explained. 

[0040] When an image is made into two sheets, (also in composition of two or 
more sheets, your considering two sheets first of all, since it is the repeat of 
composition of two sheets), and its gap can be expressed with the difference 
of advancing side by side of x and the direction of y, rotation, and a dilation 
ratio. Therefore, a point (x y), and corresponding (corresponding x', yO can be 
expressed as follows. 
[0041] 

[Equation l] 



Here, in theta, an angle of rotation, and deltax and delta y show advancing 
side by side, and m shows a scale factor. Therefore, this coordinate 
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transformation can be expressed by asking for Parameters A, B, C, and D. In 
previous corresponding-points extract processing, corresponding points (x y) 
and two or more groups of (x', yO were acquired. This is asked for Parameters 
A, B, C, and D using a least square method. 
[0042] 

[Equation 2] 



It is ****** and is [0043]. 
[Equation 3] 



It asks for the ******** parameters A, B, C, and D. It is here and is [0044]. 
[Equation 4] 
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If it carries out, Parameters A, B, C, and D can be expressed as follows. 
[0045] 

[Equation 5] 



Parameters A, B, C, and D are computed by calculating p8 from this 
parameter pi, and substituting for a top type. 

[0046] Next, image composition processing of step S13 is explained. Since it 
asked, Parameters A, B, C, and D are degree types [0047]. 
[Equation 6] 



A synthetic image can be obtained, if it is alike and substitutes. This image 
composition processing is illustrated to drawing 8 . When images are the left 
and the right images 51 and 52, the image 51 twice the magnitude of the left 
is secured as a synthetic image 53. The left image 51 is copied here as it is 
first (5lO- Next, it asks for the corresponding field (x*, yO 55 from a top type 
about the remaining fields (x y) 54 of a synthetic image. And the pixel of (x*, 
yO of the right image 52 is copied to (x, y) (520. This is performed to all the 
remaining fields of a synthetic image. 

[0048] Drawing 9 is a flow chart which shows image composition processing. 
[0049] At step S41, a twice as many field as the 1st image (left image in 
drawing 8 ) is secured as a synthetic image field. At step S42, the 1st image 
is simply copied to this synthetic image field. At step S43, it asks for a 
corresponding field (x', yO from a top type about the remaining fields (x y) of 
a synthetic image. In step S44, if (x', y') confirm whether it is movable in it 



10/16 



Japanese Publication number : 09-091407 



being in the 2nd image (right image in drawing 8 ) and there are about it, 
they will copy the pixel of (x\ yO to (x, y) at step S45. 

[0050] A repeat and synthetic processing end the above to all the remaining 
fields of a synthetic image. A panorama image can be obtained by this. 
[0051] Next, image extract processing of step S5 in which it **4**(ed) is 
explained. This image extract processing is performed in the image extract 
means 28. In this system, two or more extract methods are shown to a user, 
and an extract image is determined by choosing the method of arbitration 
firom the inside. Drawing 10 (a) ■ (d) is drawing showing how to extract a 
rectangle field fi-om the panorama image which compounded the image of 
two sheets and was able to do it. 

[0052] In order to create a panorama image, when the image of two sheets is 
photoed with an electronic camera etc., in not using a tripod etc., it is easy to 
produce a gap and an inclination between images. Drawing 10 (a) The 
images 61 and 62 of two sheets angle theta Incline, it shifts and the 
panorama image shown in * (d) is compounded, as shown in this drawing. 
With the image extract means 28 of this operation gestalt, some extract 
methods are established, and a rectangle is extracted or it makes it possible 
automatically to take and extract the middle of an inclination according to 
each image which becomes the origin of a panorama image. 
[0053] First, in this example, a rectangle 63 is extracted on the basis of the 
image which is level as for the extract method 1 shown in this drawing (a). In 
this example, a rectangle 64 is extracted on the basis of another image with 
which the extract method 2 shown in this drawing (b) was leaned for 
composition. The extract method 3 shown in this drawing (c) extracts the 
rectangle to which only the one half of the inclination between the images of 
two sheets inclined, and the rectangle 65 which inclined theta/2 is extracted 
in this example. In addition, the extract images 64 and 65 of the extract 
method 2 and the extract method 3 serve as -theta and image data which 
only -theta/2 rotates and does not have an inclination, respectively. Both the 
extract methods 4 shown in this drawing (d) extract the rectangle containing 
the image of two sheets, and a rectangle 66 hits this in this example. 
[0054] By the way, various patterns can be considered to how with which the 
image of two sheets laps. Moreover, although the extract method of a 
rectangle field can consider various things within a panorama image, in this 
system, the extract method of a rectangle field is beforehand decided about 
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all the ways of lapping. Drawing 11 is drawing showing an example of the 
rectangle which the image of two sheets laps and is extracted the direction, 
this expresses the case where it is based on the extract method 1, and the 
half-tone-dot-meshing portion in each panorama image 71 serves as the 
extract field 72. In this system, these data is held as an extract pattern table. 
A part of the extract pattern table is shown in drawing 12 . 
[0055] The line 81 of drawing 12 is equivalent to the case of the panorama 
image shown in drawing 11 . This is explained using drawing 13 . 
[0056] Drawing 13 is explanatory drawing of an extract pattern table, and 
expresses the rectangular location with the upper left coordinate and upper 
left angle of rotation theta of each rectangle. Conditions 91 are searched for 
as conditions for how depending on which two rectangles lap firom drawing 

13 to become like the panorama image 71. Moreover, the coordinate of each 
top-most vertices of the extract field 72 is searched for like 92. These data is 
stored in the extract pattern table 80, respectively. Furthermore, since it is 
necessary to rotate an extract image when each side of the field after an 
extract is not level to a x axis or the yaxis, the item which describes the 
angle at that time has also been included. 

[0057] Thus, the calculated value is stored for every lap direction of all. 
Moreover, an extract pattern table exists for every extract method. 
[0058] Next, the processing which extracts an image using the extract 
pattern table mentioned above is explained using the flow chart of drawing 

14 • 

[0059] First, in step S51, it investigates whether the panorama image to 
process is equivalent to which pattern by investigating the item of the 
"conditions" in the table corresponding to the extract method among the 
extract pattern tables mentioned above. Next, in step S52, the image data of 
the portion [ data / which corresponds from a table / of an extract field ] 
according to ejection and it is extracted from a panorama image. At 
subsequent step S53, the item of "rotation" of a table is investigated and 
extract image data is rotated if needed. 

[0060] As mentioned above, the extract image data at the time of using 
various ways of lapping and the various extract methods is obtained. 
[0061] Next, the actuation screen for choosing the rectangle extracted from a 
panorama image is shown in drawing 15 . 

[0062] 100 of drawing 15 is a screen displayed when Drag&Drop [ a user 
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catalog 34 / catalog / 31 / camera / panorama image data ] in drawing 3 . In 
drawing 15 , 101 is a panorama image display field where the image 102 by 
which panorama composition was carried out is displayed. The abstract 
image samples 103-106 express the result at the time of extracting a 
rectangle field by the various extract methods mentioned above firom the 
panorama image 102 as the contraction image, and are eqmvalent to the 
extract method 4 firom the extract method 1, respectively. 
[0063] If a user clicks the thing of arbitration with a mouse 3 firom the 
extract image sample currently displayed, the rectangle field corresponding 
to the extract method will be displayed like the extract rectangle 107 on the 
panorama image 102. Moreover, it is surrounded and expressed as a frame 
like the extract image sample 108 chosen. The rectangle field extracted by 
carrying out repeat assignment of the extract image sample can be checked 
in the panorama image display field 101 until the desired extract method is 
found. When the desired extract method is found, the image of the method 
specified is registered into a system by specifying the O.K. carbon button 109. 
In addition, the step which chooses the explained extract image can also be 
skipped by specifying the extract method as the system beforehand here. 
[0064] Although the number of the images for creating a panorama image is 
two in the above explanation and the case where they are connected with a 
longitudinal direction and compounded has been described, it can be adapted 
also for the panorama image which leads to the panorama image which 
consists of an image of two or more sheets, or all methods, without 
restricting to it. Moreover, not only the method that showed the method of 
extracting the image which serves as a rectangle firom a panorama image to 
the above-mentioned operation gestalt but various things can be adapted. 
[0065] 

[Effect of the Invention] Since it had a rectangle field extract means extract 
automatically the image data contained to the field which serves as a 
rectangle from the inside of the image after composition of two or more 
images, and a panorama image creation means created said panorama image 
based on the extract result of said rectangle field extract means according to 
the panorama image composition system of claim 1 as explained in full detail 
above, it becomes possible to obtain a good image without a dummy area. 
[0066] Since the field used as said rectangle was beforehand decided with the 
configuration of the image after composition of two or more of said images in 
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the panorama image composition system of above-mentioned claim 1 
according to the panorama image composition system of claim 2, it becomes 
possible to obtain a good image without a dummy area simply and exactly. 
[0067] Since said rectangle field extract means was considered as the 
configviration which extracts said image data with two or more rectangle 
patterns, chose the thing of arbitration from the inside and used the 
selection result as said panorama image, it can choose the extract method 
according to the contents of the image, and, according to the panorama 
image composition system of claim 3, becomes possible [ obtaining a good 
image without a dummy area simply and exactly ] in the panorama image 
composition system of above-mentioned claim 1. 

[0068] In the panorama image composition method which according to the 
panorama image composition method of claim 4 compounds two or more 
images which the part overlaps as a field, and creates the panorama image of 
one sheet Since rectangle field extract processing in which the image data 
contained to the field which serves as a rectangle from the inside of the 
image after composition of two or more of said images is extracted 
automatically is performed and said panorama image was created based on 
the extract result of the rectangle field extract processing It becomes possible 
to obtain a good image without a dummy area. 



DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing ll It is the block diagram showing the panorama image 
composition structure of a system concerning one gestalt of operation of this 
invention. 

[Drawing 2] It is the external view showing the configuration of the personal 
computer system which is the platform where the panorama image 
composition system of this invention is carried out. 

[Drawing 3] It is drawing showing the actuation which copies the image data 
in a camera into a computer. 

[Drawing 4] It is the flow chart which shows the processing performed in 
case the image data in a camera is copied into a computer. 
[Drawing 5] It is the flow chart of panorama composition processing. 
[Drawing 6] It is the flow chart of the algorithm of corresponding-points 
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extract processing. 

fPrawing 7] It is drawing showing the template image and matching range of 
corresponding-points extract processing. 

[Drawing 8] It is drawing showing image composition processing. 
[Drawing 9] It is the flow chart which shows image composition processing. 
[Drawing 10] It is drawing showing how to extract a rectangle field firom a 
panorama image. 

[Drawing 111 It is drawing showing an example of the rectangle which the 

image of two sheets laps and is extracted the direction. 

[Drawing 12] It is drawing showing an example of an extract pattern table. 

[Drawing 13] It is explanatory drawing of an extract pattern table. 

[Drawing 14] It is drawing showing image extract processing. 

[Drawing 15] It is drawing showing the actuation which chooses the 

rectangle field extracted from a panorama image. 

[Drawing 16] It is drawing showing an example of the conventional 

panorama image composition. 

[Description of Notations] 

1 Computer System Main Part 

2 Display 

3 Mouse 

4 Mouse Button 

5 Keyboard 

6 General Interface 

7 Electronic Camera 

11 Hardware 

12 OS 

13 Application Software 

14 Hard Dislc 

15 File System 

16 Disk lO Interface 

17 Drawing Managerial System 

18 Video Interface 

19 Input Device Managerial System 

20 Keyboard Interface 

21 Mouse Interface 

22 Bidirectional Interface / SCSI Interface 
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23 Image Data Management System 

24 Data Control Means 

25 Data Display Means 

26 Panorama Image Creation System 

27 Panorama Composition Means 

28 Image Extract Means 
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